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Abstract 

Constraints and universctl quantification axe both use- 
ful in planning, but handling universally quantified 
constraints presents some novel challenges. We present 
a general approach to proving the validity of univer- 
sally quantified constraints. The approach essentially 
consists of checking that the constraint is not violated 
for all members of the universe. We show that this ap- 
proach can sometimes be applied even when variable 
domains axe infinite, and we present some useful spe- 
cial cases where this can be done efficiently. 

1 Introduction 

Softbots (software robots) are intelligent software 
agents that sense and act in an environment, such as 
a computer operating system. Since software environ- 
ments are so rich, there is no limit to the kinds of tasks 
that softbots can perform, including on-line compar- 
ison shopping, managing email, scheduling meetings, 
and processing data. Planner-based softbots(EW94; 
?) accept goals from users and invoke a planner to 
find a sequence of actions (e.g., commands or program 
invocations) that will achieve the _goaj.._ 

We are working on softbots for data processing, in- 
cluding image processing, managing file archives, and 
running scientific models. Due to the richness of soft- 
bot problem domains in general, and data processing 
domains in particular, the planner needs to be able to 
handle a rich action representation. In particular, it 
must support 

• universal quantification: Many commands and 

programs operate on sets of things, where member- 
ship in the set can be defined in terms of necessary 
and sufficient conditions. For example, 

- The Unix Is (or DOS dir) command lists all files 
in a given directory 

- The “tar x” (or unzip) command extracts all files 
in a given archive. 
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~ The grep command returns all lines of text in a 
file matching a given regular expression. 

- Most image processing commands operate on all 
pixels in an image or in a given region of an image. 

• incomplete information: It is common for soft- 
bots to have only incomplete information about their 
environment. For example, a softbot is unlikely to 
know about all the files on the local filesystem, much 
less all the files available over the Internet. 

• large or infinite universes: The size of the uni- 
verse is generally very large or infinite. For example, 
there are hundreds of thousands of files accessible on 
a typical filesystem and billions of web pages publicly 
available over the internet. The number of possible 
files, file pathnames, etc., is effectively infinite. Given 
the presence of incomplete information and the abil- 
ity to create new files, it is necessary to reason about 
these infinite sets. 

• constraints: As noted in (CFL ■ 97; ?), data process- 
ing domains typically involve a rich set of constraints. 
By constraints, we mean non-fluent conditions, such 
as numeric relations, whose truth values can be com- 
puted. 

The intersection of these features poses some interesting 
challenges. For example, the intersection of universal 
quantification and incomplete information means that 
standard approaches to dealing with universal quantifi- 
cation in planning (PW92) don’t work, and other ap- 
proaches are needed (Gol98; 7; ?)• This paper discusses 
the effect of universi quantification and large/infinite 
universes on constraint reasoning and proposes a way 
to accommodate universally quantified constraints into 
a constraint-based planner. 

1.1 Universally quantified constraints 
Given a representation that allows both universal quan- 
tification and constraints, it is not surprising that we 
encounter universally quantified constraints. In fact, 
such constraints can be exceedingly useful. For exam- 
ple, to represent an image-processing command that 
performs a horizontal flip of the pixels in a rectangular 
region of an image between (MINX, miny) and (maxx, 
MAXY), w'e might write something like: 



when(MINX< X <MAXX && MINY< 
y <MAYX) 

outputvalue(x,yJ := inputvctiue(MAXX^Mih'X- 

where outputvalue(xy y) is the pixel value of the image 
output at coordinates z, j/, and similarly for mpui. value. 
We might also want to specify spatial transforms of an 
image, such as scaling or affine transforms, or changes 
to color values. All of these are convenient to represent 
using numeric constraints, quantified over the pixels in 
the image or the specified region. 

In describing commands that act on text files, it is 
useful to quantify over lines or characters of text. For 
example, the grep command outputs all lines of text 
contained in the input that match a given regular ex- 
pression: 

V/me when containsLine(mptii, line) && 
matches (mput, regexp) 
containsLine(owtptit, line) 

Similarly, many commands operate on sets of files, 
which can often be expressed in terms of a regular ex- 
pression satisfied by their pathnames. For example, the 
files recursively contained in directory “/foo/bar’’ all 
have the pathname ‘yfoo/bar/,+”, w^here means 
“any string at least one character long.” 

In both of these examples, we see that it is necessary 
to reason about constraints on variables with either in- 
finite or very large domains. 

1.2 Roadmap 

In the remainder of the paper, we discuss how univer- 
sally quantified constraints arise in the planning pro- 
cess and how they are solved. Section 2 discusses how 
universally quantified constraints arise as subgoals in 
the planning process. Section 3 presents a general ap- 
proach to solving universally quantified constraints in 
a constraint network. Section 4 presents an algorithm 
for implementing this approach and proves that the al- 
gorithm is both sound and complete. The general ap- 
proach is not always possible to instantiate w^hen there 
are infinite domains. Section 5 provides an instantia- 
tion of this general approach to efficiently handle con- 
straints with infinite domains under certain restrictions. 
Section 6 presents an example covering both planning 
and constraint reasoning. Section 7 discusses related 
work. 

2 Planning with universal 
quantification 

The traditional approach to planning with universal 
quantification, used by UCPOP (PW92) and other plan- 
ners works as follows: 

1. Universally quantified goals are replaced with the the 
equivalent universally ground conjunctive goal, which 
is called the universal base. 


2. Universally quantified effects are peeled as needed. 
That is, given an effect 

Vx when(P(x)) Q(z) 

and a goal, Q(a), a new ground effect is “peeled off’ 
the for all effect to satisfy the goal: 

when ((P (a)) Q(a) 

The result is the subgoal P(a). 

Replacing goals with their universal base depends on 
the Closed World Assumption (all objects must be 
known) and on the number of objects in the universe 
being relatively small. In softbot domains, neither as- 
sumption is likely to be valid. For example, not all files 
accessible to the softbot will be known, and the num- 
ber of avediable files can easily be thousands or millions. 
To address the problem that not all files are known, the 
softbot can first achieve a subgoal of knowing all the rel- 
evant files, and then proceed as above (EGW97), but 
that still leaves the problem that the number of files 
may be large. For example, suppose the softbot has 
the gocd of ensuring that all of the files in the user’s 
home directory are group readable. This goal could be 
achieved by identifying all the files (recursively) con- 
tained in the home directory “''user” and then ensuring 
that each one is group readable, but it it would take 
some time just to identify all the files. It is much sim- 
pler and faster to handle them all at once vith a single 
Unix command: 

chmod -R g+r ~user 

Such an approach is supported in the PUCCINI planner 
(Gol98) by directly linking from universally quantified 
goals to universally quantified effects. 

2.1 Goal regression with quantified 
variables 

The subgoaling, or goal regression, procedure- we use 
is similar to that used by PUCCINI. We use the peel- 
ing technique outlined above, with the addition that 
quantified variables in the effect can be replaced by 
quantified variables in the goal. Sppose we have a goal 
when(#^)^^^ that we want to satisfy using an effect 
when ($e)^e* If the right-hand side (RHS) of a goal 
contains multiple conjuncts, they are solved inde- 
pendently, so subgoals are all of the form when(^p)^p, 
where 'ipg is a single literal. We rely on a unification 
function MGU(^e, ^^), which returns the most general 
unifier between the effect literal sxid the goal lit- 
eral 'ipg. If the literals don’t unify, MGU returns ±. 
Otherwise, it returns a set of pairs {(uc,v^)}, whose 
interpretation is that unifies with ^^ if ^1 the con- 
straints Ue = Vg are satisfied To determine the condi- 
tions required for {when(^e)^e} to satisfy the goal, 

Tpg is matched against each of the literals using the 
following procedure. 

1 . regress ({when C$e)'V^e>» {vhen(^ 

2. let 0 



3. let C = {} 

3. let $„ := copy($e) 

4 if ^ =J_ "tlisii rs'tiir'ii f 2.ilu2rs 

5. for each {ve,yVg) £ (3 

6. if z;g is V then replace v^. in with 

7. else if Vg is V, then return failure. 

8. else C := C A Vg) . 

9. end for 

10. replace all unmatched V variables in 

11. return {when($p) 

where the new 3 variables are inside the scope of ail 
V variables from the goal. This subgoaling procedure 
alone is not sufficient for the planner to be complete, 
because it provides no way to determine that two or 
more effects combine to achieve a universally quanti- 
fied goal. An additional technique, called goal parti- 
tioning, implemented in the PUCCINI planner (Gol98; 
?), provides this ability, but at a high computational 
cost. We are investigating a way to lower this cost, but 
that is outside the scope of this paper. 

For example, suppose that we have an action to give 
a Mothers’ Day card to ail new mothers: 

Vpi,p 2 T®^son when(pi =parent(p 2 ) sex(pi) 

= female && age(p 2 ) < 1) 
has-card(pi) 

and our goal is to give a card to Mary {ie., has- 
card(Mary)). Applying this action to satisfy the goal 
will result in the subgoal 

3^2 -Person (Mary = parent (p^) sex(Maiy) = 
femal^(£& age(p2 'J < 1)” ' 

That is, the action will achieve the goal if Mary is fe- 
male and has a child less than one year old. Note that 
although p 2 is universally quantified, p '2 is existentially 
quantified. It is not necessary for Mary to be the parent 
of all children under one year of age; any one child will 
suffice. This is true in general; any unmatched lihivef- 
sally quantfied variable v in the effect is replaced with 
an existentially quantified variable in the subgoal. 
The reason is that since the effect occurs for all v that 
satisfy and v doesnT matter (isn’t mentioned in the 
goal), it is only necessary to find some v that satis- 
fies Note that if it the effect were of the form “give 
a card to everyone who is the mother of all children,” 
then it would indeed be necessary for p '2 to be univer- 
sally quantified in the subgoal. However, as we discuss 
below, quantifiers can’t be nested within antecedents 
and existentials are not allowed in effects, so effects of 
that form are impossible to state. 

Now suppose our goal is to give a card to all mothers 
of newborn boys: 

Vm,s:person when(m =parent(s) && sex(m) = 
female && sex(s) = male && age(s) = 0) has- 
card(m)) 

If we use the action to give a card to all new mothers, 
the subgoal then becomes 


Vm, siperson when(m =parent(s) sex(m) 

= female, && sex(s) = male && age(s) = 0) 
|( 77 x =parent(s) && sex(7n) = female && age(s) 

< 1 } 

• Note that the left hand side of this expression is just 
the left hand side of the original goal, and the right 
hand side is the “peeled” left hand side of the effect. 
All subgoals from conditional effects are generated the 
LHS expression is carried back 
through successive goal regressions. 

The RHS literals m =parent(s) and sex(m) = female 
are clearly entailed by the LHS, which we can determine 
by unification, using a slight variation on the regression 
procedure above. When the LHS entails a literal on the 
RHS, we say that the goal literal is trivially satisfied, 
and remove it without further subgoaling. 

The remaining goal condition, a constraint, is not so 
straightforward. Although age(s) = 0 clearly entails 
age(s) < 1, the two do not unify. As we discuss below, 
the purpose of universally quantified constraints is to 
answer the ent ailment question for constraints. 

2.2 Restrictions on universally quantified 
expressions 

Given the requirement to support universally quanti- 
fied goals directly with universally quantified effects, 
it is important to specify exactly what kinds of expres- 
sions the language will allow, since the unrestricted case 
would require first-order theorem proving, which is un- 
decidable. 

- 2v2-.0.0:l Effects All universally quantified effects- 
are conditional effects, in which the antecedent speci- 
fies restrictions on the universe(s) of the quantified vari- 
able (s) and the consequent specifies what will become 
true for members of the specified universes. These ef- 
fects are of the form 

Vf,y (when(<^(£,y,uJ)) ^(:r,^)). 

where ^ and ^ are conjunctive expressions and vari- 
ables in w are action parameters, variables in action 
schemas that need to be instantiated in order to obtain 
concrete actions. Limiting ^ to a conjunction is not a 
real limitation, since an expression of the form 

when (^1 V $ 2 ) ^ 

can be rewritten as the conjunction of “when($i) ^ 
and “when(^ 2 ) ^ ” 

Effects cannot contain existential quantifiers, or 
anything equivalent to existentials, such as universal 
quantifiers nested within an antecedent or negation. Al- 
lowing existentials or disjunctive consequents in effects 
would make them nondeterministic. Given the lack of 
nesting and existentials, all universals can be treated as 
free variables. All quantified variables appearing in ^ 

^Effects can introduce the creation of new objects, 
through the new keyword, which is similar in some respects 
to an existential quantifier, but that is irrelevant to the topic 
of this paper. 



must also appear in #. This is just a sanity check, since 
the domain of any quantified variable that does not ap- 
pear in f is completely unrestricted. $ may contain 
additional quantified variables, y, that don’t appear in 
For example, in the Mothers’ Day effect presented 
above, the variable p 2 appears only in 

2. 2. 0.0. 2 Goals and preconditions The syntax 
of universally quantified goals and action preconditions 
is the same as that of effects, except that existential 
quantifiers nested within the universal quantifiers are 
allowed in 

Vf,^£(when($(x,y,u;)) 

As with effects, the use of the keyword when indicates 
that ^{x^y^w) and "^{x.z^w) refer to different times. 
That is, for all all x that satisfy #{x, F, w) when the goal 
is given (i.e., in the initial state), we want ^{x, z,w) to 
be true (for some z) when the goal is achieved (t.e., in 
the final state). Thus, we can specify goals like “paint 
all the blue chairs green” without contradiction: 

Vc: chair when (color(c) = blue) color(c) = green 

Goals can also explicitly refer to time. For example, we 
can ask for data on last Tuesday’s rainfall. Whereas 
effects are not really restricted compared to the com- 
monly supported subset of ADL (Ped89), the limita- 
tions on universally quantified goals are more restric- 
tive. This particular set of restrictions was chosen to 
support the class of go£ds required for the softbot do- 
mains that we are interested in, while simplifying the 
^inference procedures. 

2. 2. 0.0. 3 Subgoals Subgoals are just goals, and 
obey the same restrictions. However, since subgoals are 
generated through a specific process, outlined above, it 
is worth showing that the process maintains the restric- 
tion on goals. 

• Since the subgoaling process always copies the left- 
hand side (LHS) of the goal to the LHS of the subgoal, 
all restrictions obeyed by the former are obeyed by 
the latter. In particular, the LHS is conjunctive and 
it can contain no existentials. 

• The RHS of the subgoal comes from the (peeled) LHS 
of the effect. Since the latter is conjunctive, so is the 
former. 

• Quantified variables appearing in the RHS but not 
in the LHS are existential. To see why, consider that 
every quantified variable that appears in the RHS 
either originated in the goal or is a copy of a variable 
from the effect. 

1. If the variable appeared in the goal, then it cannot 
have been in the LHS of goal, since otherwise it 
would be in the LHS of the subgoal, contradicting 
our assumption. Since it was not in the LHS of the 
goal, it must be an existential. 

2. If the variable came from the effect, then it must 
be an existential, since, as indicated in line 10 of 


the regression algorithm, all universals in the effect 
that aren’t replaced by variables from the goal are 
replaced by existentials. 

2.3 From planning to constraints 
In the remainder of the paper, we discuss how to tell 
if the LHS of a universally quantified subgoal entails 
the RHS when both sides contain constraints. We will 
not concern ourselves further with the details of the 
planning algorithm. We can convert the whole plan- 
ning problem into a constraint problem, but it would 
also be possible to use a POOL planner like PUCCINI 
(Gol98), and perform constraint reasoning to answer 
questions about whether certain subgoals are trivially 
satisfied (the LHS entails the RHS). In either case, we 
can separate the problem of solving forall constraints 
from the rest of the planning problem. 

We assume that the planner produces candidate plans 
that are complete except for the instantiation of some 
action parameters and are correct subject to a list of 
subgoals being 'trivially” satisfied (i.e. no more actions 
need to be inserted into the plan. The planner sends 
the constraint reasoner this list of subgoals, which are 
of the form 

Vx, ^z ($(£, y, w) ^(5, z, u;)) 

along with some additional constraints on the parame- 
ters, The job of the constraint network is to either re- 
turn an assignment to all of the unspecified parameters 
(w) such that all of the subgoals are trivially satisfied, 
or return failure in case there is no such assignment. 

If the c onstraint network returns failure then the can- 
didate plan is invalid, so the~ planner should'Tontihue 
searching. Otherwise, the candidate plan, instantiated 
with the values for w returned by the constraint net- 
work, is a valid plan. 

3 Solving Quantified Constraints 
Before describing the approach further, we introduce 
some notation. Let X be a set of variables. Denote 
the domain of r G X as d(x). Let D be the set of do- 
mains. Let k = (xi.,,Xi]R) be a constradnt; Xi €. X and 
R C d(x\) X ,,,d(xi) is a relation defining the permitted 
assignments to the variables. Let K be the set of con- 
straints. Then C(X) = (X, D, K) is a GSR A solution 
to the CSP is an assignment of values to the variables 
such that all constraints are satisfied. Let S{C) be the 
set of solutions to C. Let L be a relation on a set of vari- 
ables Cf, and let 7Ty{L) be the projection of the relation 
L onto the set V C U . A CSP is k-consistent if any 
consistent assignment to k-1 variables can be extended 
to an assingment to k variables (k=2 is arc consistency.) 

A CSP is strongly k-consistent if it is k-consistent for 
all k. Let $(a),^(6) be CSPs. We then refer to a 
constraint of the form V£, ($(:?, w) ^{x^ z, w)) 

as a quantified constraint^ and refer to the constraints 
comprising $ (a), ^(6) as primitive constraints. 

The general approach to solving quantified implica- 
tions is straightforward. Given an expression of the 



form “all things that satisfy $ also satisfy we iden- 
tify the set of things that satisfy $ and check w^hether 
they also satisfy 4^. We can think of this as an em- 
pirical proof technique: we’re doing nothing more than 
checking the validity of the expression for all members 
of the universe. 

More formally, given a quantified constraint 

The variables in w must be assigned values by a search 
procedure. As mentioned in Section 2, these variables 
represent the parsuneters of actions; the search over 
these values, in essence, is the search over candidate 
plans. During this search, we can propagate the do- 
mains of the variables in 5, y^w based on but do not 
assign these variables. We do not propagate based on 
the constraints in because these constraints do not 
hold unless the universe of discourse defined by $ is not 
empty. Once all of these variables are assigned, we are 
left with the constraint 

Vf, ^(5, f)), 

where x represents one or more universally quantified 
variables common to ^ and Again, as described 
above, the desired semantics of this implication is that 
everything satisfying # also satisfies Thus, we must 
identify the set of tuples corresponding to the assign- 
ments to X that satisfy and check that each 

tuple also satisfies i). To do this, we solve both 
and z) for x. We then check to see if 
C 7T{^}5(^(x,f}) . Because the quanti- 
fied constraint takes the form of an implication, if the 
set of solutions to $ is empty, then the implication is 
satisfied vacuously, and there are no constraints on the 
values of the variables in x . If there are solutions to ^ 
but 7 T(^} 5 ($(x,^) 2 7T{£}5(^(x,iO), then the quanti- 
fied constraint is not satisfied, and some other assign- 
ment to the variables in w must be generated. Other- 
wise, the constraint is satisfied, and the domains of x 
are defined by the the restrictions imposed by 

If the set of tuples satisfying $ is finite, then enumer- 
ating them and checking that each one of them satisfies 
^ is relatively straightforward, though possibly time 
consuming. But what if the set is infinite? In the gen- 
eral case, there is nothing that can be done. However, 
ais we will see, there are some useful classes of problems 
where it is possible to identify the infinite set of tuples 
satisfying ^(x, y) and check that they all satisfy' ^(x, z) 
using efficient constraint propagation techniques. 

It should be noted that the steps presented above 
can be done in a variety of ways. There is no need to 
assign all variables in w before beginning the process 
of identifying the domain of x. It is also possible to fix 
the domadns of x after solving $ before solving "if and 
only check to see if any elements of these domains are 
eliminated during the solving of These refinements 
are left as future work. 


4 Algorithm 

We present an algorithm for proving that universally 
quantified constraints are valid. The only assumptions 
are that there is a way of enumerating the variables 
in uJ, and that there is some way of representing the 
values satisfying $(x, ^ and 4^(x, y). In the following 
sections, we discuss specific techniques for performing 
these operations. 

1. choose assignments for all normal variables w 

2. for each quantified constraint Vx, y, 3z.^(x, y) 
^^(x, z^ 

3. ’ 

4. for (each assignment a G 

iO)) 

5. if (a ^7r{£}S'('5'(r, j/))) 

6. return failure. 

7. end for 

8. end for 

9. return success. 

Theorem: The algorithm for proving quantified con- 
straints is sound: it will not return success if, 

for any quantified constraint, Vx,y,3z.^{x,y,w) => 
'^{x,z,w), there is some assignment a to x such that 
3y,Vz.^{a,y, w) A -'^'(5, z, w). 

Proof: Suppose otherwise. There is some some a 

such that 3y, V£.$(a, y, to) A -■'I' {a, z,w). The algorithm 
will only return success if each each Wi G w is singleton, 
and line 6 is not reached. This happens if 

1. There are no quantified constraints (line 2). This 
contradicts the assumption that there is such a con- 
straint. 

2. 5($(x, y, m) = 0 (line 3). This is equivalent to saying 
$ is false for all x, contradicting our assumption that 
there was some a for which $ was true. 

3. S(^(x,y,w) ^ 0 and there is no a such that a e 
7r{£}5($(x, y, w)) and a ^ 7T{£)5 («'(x, y, uI)Himes 4, 

5). That is, there is no d such that 3y.$(5, y, w) and 
Vz'.(-'^'(a,z,m)), contradicting the assumption that 
3y, V£.$(a, y, w) A z, w). 

Theorem: The algorithm for proving quantified con- 

straints is complete: If, for all quantified constraints, 

Vx, y, 3z’.$(x, y, w) => z, w), then the algorithm re- 
turns success. 

Proof: Suppose the algorithm returns failure, but 

for all quantified constraints, Vx,y, 3z.$(x,y, m) 

^{x,z,w). The algorithm will return failure 
if there is some quantified constraint for which 
^(^(x,^,^)) # 0 and a € 7 T{£} 5 ($(x,y,tZf)) 

but a ^ 7 T{£} 5 (^(x,z,u))) (line 6). But then 
X{£}5($(x,y,m)) C 7r{£}5(^'(x, which in turn 



violates the assumption that for all quantified con- 
straints, Vf, y, 3z.#(x, y, w) ^ ^(f , z, uJ) . 

5 Handling infinite universes 

The general approach discussed above works well for 
relatively small, finite domains. To handle large or infi- 
nite domains efficiently, we need to employ special-case 
constraint propagation techniques. We describe one 
such technique in detail in this section. The technique 
depends on being able to represent infinite domains con- 
cisely. In sections 5.1 and 5.2, we discuss concise repre- 
sentations of infinite domains for numbers and strings, 
and discuss classes of constraints for which these con- 
cise representations can store the valid domains exactly. 
In section 5.3, we discuss a way to use these domains 
to store the solutions of # and 
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5.1 Numeric domains 

Large or infinite sets of numbers can be represented 
concisely using intervals. Additionally, we can deter- 
mine whether two intervals are equivalent efficiently 
We will assume that all infinite numeric domains are 
represented as single intervals. Thus, the question of 
whether the domain of a numeric variable can repre- 


sent exactly the possible values allowed by a constraint 
reduces to the question of whether the values for that 
variable allowed by the constraint can be represented 
as an interval. Assuming that the domains of the other 
variables in the constraint are also represented as inter- 
vals, the question then becomes whether the projection 
of an interval on one variable is an interval on another. 
We will consider both continuous (real) and discrete 
(integer) domains. 




(h) 

5. 1.0. 0.4 Continuous If the domain of x is contin- 
uous, then for every continuous function y = /(r), if the 
domain of x is an interval, the domain of y will also be 
an interval. The converse is not necessarily true. How- 
ever, the converse is true if / is either non-decreasing (a) 
or non-increasing (b). If f{x) increases and decreases in 
X, then there will be some y interval that corresponds 
to multiple x intervals (c). However, if the y interval 
obeys certain restrictions, then the domain of x will still 
be an interval. In particular, 

• neither of the horizontal lines representing the 
bounds of the y interval may cross / more than twice. 
Crossing twice corresponds to passing through one 
peak or trough in /. 

• if one of the lines passes through a peak, the other 



line must be above the peak (d), and if one line passes 
through a trough, then the other line must be below 
the trough. 

We can apply the same sort of reasoning to relations 
(e) . However a special class of relations is worth noting. 
If any relation defines a convex region (d), such that 
the relation is true for all points inside the region and 
false for all points outside it, then the projection of any 
interval on y will be an interval on x (or vice versa). 
Examples of convex regions are, 

• 2: < 10 

• y > 2x 



X dom 







5. 1.0. 0.5 Continuous to discrete A function 
from a continuous (real) variable to a discrete (inte- 
ger) variable is by definition not a continuous function. 
However, it may be regarded as a continuous function 
whose range is projected onto the integer number line. 
If such a description is valid, then the projection of 
any continuous interval on x will be a discrete inter- 
val on y. Going the other direction, intervals on y will 
map to intervals on x under the same circumstances as 
in the fully continuous case: non-decreasing functions, 


non-increasing functions, and relations defining convex 
regions. 

5. 1.0. 0.6 Discrete A function whose domain is 
discrete will not, in general, project an interval onto an- 
other interval. For example, consider the simple case of 
y rr 2x, where x and y are integers. The domain of y is 
the set of even numbers, which cannot be represented as 
an interval. However, when we consider relations defin- 
ing convex regions, we again find that the projection of 
an interval is an interval. So although y = 2x does not 
give an interval, y <2x does. 

5. 1.0. 0.7 Other domain representations The 
decision to represent a numeric domain using a sin- 
gle interval has had a profound impact on the class 
of constraints that we can “solve” for particular vari- 
ables. Another representation, such as a fimte set of 
intervals, would allow additional constraints to be han- 
dled, though at the cost of some additional complexity 
in constraint execution. 


5.2 String domains 

Just as infinite sets of numbers can be represented by in- 
tervals, infinite sets of strings can be represented by reg- 
ular expressions. Regular expressions are a much more 
flexible representation than intervals, in that the set of 
regular expressions is closed under intersection,, union 
and negation, w’hereas the set of intervals is only closed 
under intersection. Regular expressions (regexps) are 
equivalent to finite automata (FAs) in expressive power, 
and in fact we represent regexps as FAs, since the lat- 
ter are easier to compute vdth. For example, deciding 
whether two FAs accept the same language can be done 
efficiently. 

5. 2. 0.0. 8 Concatenation The concatenation of 
two strings, a and 6, yields another string, c. This con- 
straint is represented as c = d -I- 6. If the domains of a 
and 6 are regexps, the domain of c will simply be the 
regexps resulting from concatenating the regexps for a 
and b. Less obviously, if the domains of a and c are reg- 
exps, the domain of 6 is a regexp. To construct an FA 
for b given FAs for a and c, we in effect traverse the FAs 
for c and a in parallel. Whenever a transition is allowed 
by both c and a, that transition is taken. Whenever an 
accept node in a is reached, the corresponding node in 
c is marked. A new NFA for b is constructed by copying 
the NFA for c and making ail the marked nodes start 
nodes. A similar procedure can be used to construct an 
NFA for a, given NFAs for b and c. 

5. 2. 0.0. 9 Containment The relation contains(a, 
b) means that string 6 is a substring of a. If the do- 
main of 6 is a regexp r, then the domain of a is simply 
the regexp where means “accept any charac- 

ter,” so means “accept any string of zero or more 
characters.” Less obviously, if the domain of a is a reg- 
exp, then so is the domain of b. Given an FA for a, we 
can construct an NFA for b by eliminating any dead-end 


nodes from a (that is, nodes from which it is impossible 
to reach an accept node), and then making all nodes in 
a both start and accept nodes. 

5.3 Tractable Reasoning 

In the previous sections we established that we can en- 
force consistency on a variety of constraints, even when 
the domains are infinite. We now show how to use these 
results to demonstrate that a quantified constraint is 
satisfied. In order to do this, we need some additional 
definitions. Let C(X) be a CSP. Consider the hyper- 
graph C?c7i where the vertices of G are the variables of 
C and the hyperedges are the constraints. Assume we 
have imposed a total order on the variables X. Preuder 
(FVe82) defines the width of a variable x as the num- 
ber of variables earlier in the ordering that are in the 
scope of a constraint on x. The width of an ordering is 
the maximum width of a variable, and the width of the 
CSP is the minimum width over all orderings. 

We restate the following theorem from(PYe82) with- 
out proof; 

Theorem: Let C be a CSP, If C is strongly k- 
consistent and the width of C is < A:, then there is 
a backtrack-free procedure to find a solution to C. 

We can now prove the following: 

Corollary: Let C be a CSP and assume C is strongly 
k-consistent and the width of C is < k. Let x be the 
first variable in a search order inducing a width of < k. 
Then d{x) = TT^iSiC)). 

Proof: We will show that each element of d{x) can 
be extended to a solution to C, For each a € d(x) make 
the assignment x = a. Consider the assignment of any 
variable y. Now, since the width of C is < A;, we know 
that when we use a variable ordering that induces a 
width < ky fewer than k variables sharing constraints 
with y are assigned before assigning y. Further, since 
we also know that C is strongly k-consistent, any con- 
slsten^t, ^signment of fewer than k y^iables can always 
be extended by one assignment. Thus, we can continue 
assigning variables without failure until all variables are 
assigned, regardless of the initial assignment to r. 

Thus, any $ and ^ for which k-consistency can be 
established and for which the single shared universally 
quantified variable x is the first variable in the search 
order for both ^ and ^ can be handled this way. For in- 
finite domains, achieving strong k-consistency requires 
the constraint to be similar to one of those described in 
sections 5.1 and 5.2. 

6 Example 

In this example, we illustrate the entire planning pro- 
cess, including generating subgoals through regression, 
determining entailment through unification and com- 
puting entailment for universally constraints with infi- 
nite domains. 

Suppose we have a grayscale image corresponding to 
the elevation over some region: 

plot.xSize = XMAX; 


plot . ySize = YMAX; 

Vx,y: unsigned, el: veal, 

when(x < XMAX Ay < YMAX A 

el =elevation (xProj (x) ,yProj (y) ) ) 
plot. value(x, y ) = hProj(e/) 

where xProj and yProj are linear functions mapping the 
X, y coordinates of the image to the corresponding lon- 
gitude, latitude that they represent, hProj is a linear 
function mapping elevation to pixel values in the im- 
age, with lower (blacker) values correspond to lower 
elevations, and elevation (x, y) is the elevation at lon- 
gitude Xj latitude y. The notation plot.xSize denotes 
the horizontal size of the image plot, and plot.value(x, 
y) means the pixel value at the coordinates x, y in the 
image plot. 

Say we would like to produce a color image showing 
the same elevations, but highlighting particular ranges 
of elevation using different colors. For example, pixels 
corresponding to points below sea level should be blue 
and points above the snow line should be shades of gray. 

One way to accomplish this would be by creating 
bitmaps or monochrome images cooresponding to the 
the pixels of interest (z.e., pixels above or below a par- 
ticular value), and using these bitmaps to select the 
pixels on which particular operations, like coloring the 
pixels blue, will be performed. Suppose we have a 
threshold command, which takes an image, in, as in- 
put and has an argument specifying a threshold value, 
and outputs an image, outy the same size as the input, 
with a value of 255 for every pixel in the input whose 
value is above the threshold and a value of zero for every 
pixel below the threshold: 

Vr, y: unsigned, 'i/': pixel Value 

when ( X < m.xSize && y < in.ySize && 

V = m.vaiue(r, y) ) 
when(u<^/ire5h) out.value(o:,y) := 0; 
w^hen {v>thresh) out.value(x,y) 255; 

where thresh is an action parameter of type pixelValue 
(f.e., a variable from w) denoting the threshold value, 
and a pixelValue is an integer in the range [0,255]. 
The use of nested whens is merely a shorthand, where 
“when ($i) {when ($ 2 ) is equivalent to “when 
($iA^ 2 ) This example is explored in more de- 

tail in (?). Here, we focus on a single subgoal that 
arises during planning: to generate a threshold map, 
sea, based on elevation at sea level: 

Vx', y': unsigned, elev: real. 

when(x'<XMAX A y'<YMAX A 

e/ei?=elevation(xProj(a:'),yProj(yO)) 

when [elev > 0) 5ea.value(x,y) = 255; 
when {elev < 0) 5eo.value(x,y) = 0; 

where words in ALL CAPS are constants. Regressing 
this subgoal through the threshold action, we get: 

Vx', y' : unsigned, elev: real, 3u':unsigned 
when(x'<XMAX kk y'<YMAX kk 

e/et;=elevation (xProj (x').yProj(y'))) 



x' < m.xSize; 

?/' < m.ySize; 

t;' = m.value( 2 :; y)\ 

when [dev > 0) v^> thresh] 

. when {dev < 0) v'< thresh] 

We try to satisfy this goal using the initial state; specif- 
ically, letting the image in be plot. 

V 2 :', : unsigned, elev: real 3u': unsigned 3eZ':real 

when(o;^<XMAX && y^<YMAX && 

e/ei;— elevation(xProj(x'),yProj(yO)) 

x' < XMAX; 

2/' < YMAX; 

z;' hProj(er); ■ 

eV =e!evation(xProj(x’),yProj(y'))); 

in —plot; 

when [dev > 0) v^> thresh] 
when [elev < 0) v'<thresh\ 

The subgoal eV =elevation(xProj(a:0,yProj(y'))) is triv- 
ially satisfied by unification if eV —elev. The subgoals 
x' < XMAX and y' < YMAX are also trivially satisfied. 
This can be determined easily by quantified constraint 
reasoning: The domain of x' established by the LHS 
is [0,XMAX-1], and the same domain is established by 
the RHS. Removing the satisfied terms, we get: 

Vx', y^ unsigned, elev: real 3v': unsigned 3er:real 
when(x^<XMAX && y'<YMAX && 

eZe?;=elevation(xProj(x'),yProj(y'))) 

t;' z= hProj(er); 

el' = elev ; 

when {dev > 0) v'> thresh] 
when {elev < 0) v^< thresh] 

which, simplified to it essence, gives us the following 
two quantified constraints. 

Vea: real. {ei > 0) =^{hProj{ei)> thresh) 

Ve 2 ‘ real. (c 2 ^ 0) =^(hProj(e2)^t/ire5/i^ 

Re~call that hProj is an increasing linear function. As- 
sume hProj(e)=0.05e -h 42. Note that although the do- 
main of hProj is unbounded, the range is [0, 255], so all 
values of e below -840 map to 0, and all values above 
4260 map to 255. Since we map real values onto inte- 
gers, we will always round up. 

These constraints share the parameter thresh., which 
needs to be assigned a value. As discussed above, there 
are a number of possible variable ordering strategies 
we could employ, the default being to choose a value 
for thresh and then see if the quantified constraints are 
satisfied. Say we pick the value 43. Let’s tackle the 
constraint on ei first. Enforcing the LHS constraint 
sets the domain of ea' to the interval (0, 00 ). On the 
RHS, propagating the value of thresh, sets the domain of 
hProj(ei) to [44,255]. The domain of ei then becomes 
(20, 00 ). Since the domain of ei is not the same as it 
was according to the LHS, the constraint is violated, so 
43 is not a valid assignment to thresh. 

Now say we pick 42. Once again, the domain of ei 
is (0, 00 ) . This time, propagating thresh in the RHS 


makes the domain of hProj(ei) [43,255], resulting in a 
domain for ti of (0, 00 ), which is consistent with the 
LHS, so we proceed to the other forall constraint. En- 
forcing the LHS sets the domain of 62 to the interval 
(- 00 , 0 ]. Propagating the value of thresh in the RHS 
sets the domain of hProj(e 2 ) to [0,42], resulting in a 
domain of (- 00 , 0] for 62 - Both forall constraints are 
consistent. 

An alternative to branching on values of thresh would 
be to leave it unassigned and see if we can narrow down 
the choices through propagation. Working on the con- 
straint on ei first, we enforce the LHS constraint, set- 
ting the domain of ei to the interval (0,oo). Propa- 
gating the value of Ci, the domain of hProj(ei) is then 
[43, 255] and the domain of thresh is [42, 255]. Since en- 
forcing the RHS constraints did not shrink the domain 
of ei, the first implication is valid so far. Enforcing 
the LHS of the second constraint sets the domain of 
C 2 to the interval (— 00 , 0]. Enforcing the RHS sets the 
domain of hProj(e 2 ) to [0,42] and restricts the domain 
of thresh to the singleton 42. The domain of 62 did 
not shrink, and the reduction of the domain of thresh 
did not shrink the domain of ei, so both implications 
hold, and the only valid parameter choice is 42, which 
is hProj(O), the pixel value cooresponding to sea level. 

7 Previous Work 

The Amphion system (SWL+94) was designed to con- 
struct programs consisting of calls to elements of a soft- 
ware library. Amphion was supported by a first-order 
theorem prover. The task of assembling a sequence of 
image processing commands is similar to the task Am- 
phion was designed to solve. However, the underlying 
representation we present here is a subset of first-order 
logic, enabling the use of less powerful reasoning sys- 
tems. 

Ginsberg and Parkes (GPOO) point out that the satis- 
fiability encoding of many STRIPS planning problems 
fe^ir^ 5f eating multiple grounded instances for ax- 
ioms of the form Vxyz.(a(x, y) A 6(y, z) => c(x, z), then 
performing search over the truth values for all of the 
grounded instances. They propose a formulation in 
which a(x, y)), b{y, z) and c(x, z) are constraints on vari- 
ables X, y, z and use this formulation to either search for 
units or find good variables to flip in local search. This 
is a different restriction oh first-order logic from that 
we use, and furthermore, the domains of x, y, z are im- 
plicitly assumed to be finite. 

Other planners, including (GEW94; ?; ?) also sup- 
port universal quantification. The universally quan- 
tified statements in PSIPLAN (BSOO) can include in- 
equality constraints, which are used to exclude individ- 
uals from the universe of discourse. However, no prior 
planning systems support the ability to determine the 
validity of universally quantified constraints that we dis- 
cuss here. 

L’Homme (L’H93) and Marriott and Stuckey (MS98) 
both describe methods of preserving an interval repre- 
sentation of variables involved in arithmetic constraints 



wliilG Glimins^ting infeasiblG vcduGS. However, they ex- 
plicitly assume that the interval representation is an un- 
sound approximation to the domain of feasible values. 
Benhamou and Goualard (BGOO) describe a method of 
sound but incomplete approximate propagation of in- 
finite domains. Since we require both soundness and 
completeness in cases where that set may be infinite, 
we have made stronger restrictions on the types of rea- 
soning performed. 

8 Conclusions and Future Work 

We have described a planning methodology for softbots 
that supports universal quantification, incomplete in- 
formation, and constraints on variables with very large 
or infinite domains. We restrict the form of both goals 
and effects, while preserving the ability to express con- 
ditional effects and reason about incomplete informa- 
tion. Our approach uses a combination of unification 
and constraint reasoning to demonstrate entailment. 
We described an algorithm for proving or disproving 
entailment for constraints over finite domains, and iden- 
tified a subclass of constraints for which the same al- 
gorithm can prove or disprove entailment for variables 
with infinite domains. This class of constraints has 
proven useful in the domains of planning for image pro- 
cessing and managing file archives. 

When describing the algorithm to validate quanti- 
fied constraints, we assumed that all parameters of the 
actions were assigned before validation occurs. As de- 
scribed in Section 6, there are times when it is worth 
deferring the decision about parameters to actions, be- 
cause propagation will limit the possibilities. Exploit- 
ing these possibilities is the subject of future work. 

We can potentially weaken the conditions on quanti- 
fied constraints required to reason about variables with 
infinite domains. The condition that ^ and ^ share 
only one variable can be relaxed w’^hen there is a proce- 

checking the validity of the constraint vdthout 
checking infinitely many values. One case is when all 
of the constraints describe linear equations or inequal- 
ities. In addition, it may be possible to generalize the 
conditions under which consistency enforcement allows 
us to conclude that all the values of a variable partici- 
pate in solutions to a CSP. Finally, we can try to find 
more constraints on which we can enforce consistency 
when domains are infinite. 

We currently assume that it is necessary to maintain 
both soundness and completeness while reasoning about 
constraints. In the case of large finite domains, this rea- 
soning is slow, but for infinite domains outside the lim- 
ited cases we discussed the reasoning may become im- 
possible. Introducing unsoundness into the constraint 
reasoning is unlikeley to be effective; since the quan- 
tified constraint must be satisfied, all elements of the 
universe satisfying the LHS and RHS must be identified 
eventually, and unsoundness only postpones this prob- 
lem. Benhamou and Goualard (BGOO) introduce sound 
but incomplete reasoning in order to maintain tractable 
representations of infininte domains. However, it may 


be worthwhile to consider the effects of sound but in- 
complete reasoning on the planning process. 
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